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'  .  ABSTRACT 

^Vhe  simplex  method  Is  a  widely-used  technique  In  analytical  chemistry. 
Although  primarily  viewed  as  a  technique  for  experimental  optimization,  this 
method  Is  also  used  for  mathematical  modeling,  such  as  nonlinear  least 
squares  curve  fitting.  Acceptable  methods  of  chemical  data  analysis  require 
estimates  of  both  the  parameter  values  and  their  errors  -  something  which  is 
not  provided  by  current  simplex  algorithms.  This  paper  proposes  a  procedure 
for  obtaining  error  estimates  of  the  fitted  parameters.  The  proposed  method 
can  be  easily  Implemented  on  a  laboratory  minicomputer,  greatly  enhancing 
the  utility  of  the  simplex  method  to  analytical  chemists.  This  procedure  Is 


first  described  for  a  general  function,  and  then  Illustrated  using  a  data 


I 
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INTRODUCTION 

Many  chemical  and  physical  problems  Involve  locating  the  position  of  an 
optimum  (e.g.,  a  maximum  or  minimum  response)  which  Is  a  function  of  several 
variables.  By  simultaneously  varying  several  factors,  the  simplex  method  Is 
a  much  more  efficient  technique  for  finding  such  an  optimum  than  traditional 
methods  of  varying  one  factor  at  a  tlme(l).  This  technique  was  Introduced 
In  1962  by  Spendley  et  al.(2)  for  optimizing  either  physical  processes  or 
mathematical  functions.  Nelder  and  Mead(3)  modified  the  original  work  to 
allow  the  simplex  to  expand  or  contract  according  to  the  layout  of  the 
response  surface,  greatly  Increasing  the  potential  utility  of  the  method. 

In  an  early  application  to  analytical  chemistry,  Long(4)  used  the 
simplex  method  to  optimize  the  colorimetric  determination  of  sulfur  dioxide. 
However,  It  was  not  until  Demlng  and  Morgan(l)  began  to  promote  the 
procedure  In  1973  that  the  simplex  method  began  to  find  widespread  use  among 
analytical  chemists.  Largely  as  a  result  of  their  work,  this  technique  Is 
now  widely  used  by  analytical  chem1sts(5).  Among  Its  many  applications, 
simplex  optimization  finds  extensive  use  In  the  development  of  analytical 
methods  and  In  optimizing  the  performance  of  analytical  Instruments (6) . 

Although  primarily  used  by  chemists  for  experimental  optimization,  the 
simplex  method  has  also  been  used  for  mathematical  modeling,  such  as 
nonlinear  least  squares  curve  f1tt1ng(7).  In  fact,  Nelder  and  Mead(3) 
emphasized  function  minimization  In  their  work  on  the  simplex  method.  A 
simplex  algorithm  for  nonlinear  data  analysis  has  recently  been  published  as 
part  of  a  work  on  computer  applications  In  chemlstry(B).  However,  most 
analytical  chemists  use  nonlinear  least  squares  routines  based  on  gradients 
(first -order  derivatives)  or  on  the  Hessian  matrix  (second-order 
derivatives).  The  advantages  and  disadvantages  of  these  methods  when 
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compared  to  the  simplex  method  depend  largely  on  the  type  of  Information 
being  sought.  In  experimental  optimization  the  functional  relationship 
between  variables  Is  usually  not  known;  the  simplex  technique  performs 
excellently  while  derivative-based  methods  fall  completely. 

The  simplex  method  does  have  some  advantages  even  when  the  mathematical 
model  Is  known.  One  advantage  Is  the  absence  of  evaluation  of  partial 
derivatives.  Despite  Its  apparent  simplicity,  the  calculation  of  derivatives 
can  be  a  source  of  problems.  Incorrect  differentiation  or  errors  In 
programing  the  calculation  of  derivatives  has  been  shown  to  be  one  of  the 
most  common  causes  of  failure  In  nonlinear  least  squares  algor1thms(9) .  As 
the  function  being  minimized  becomes  more  complex,  this  advantage  becomes 
more  attractive.  The  size  of  the  algorithm  Is  significantly  reduced  by  the 
absence  of  derivatives;  the  remaining  calculations  are  simple  and  can  be 
easily  programmed  on  a  laboratory  minicomputer.  Probably  the  most 
significant  advantage  of  the  simplex  method  Is  Its  robustness  with  respect 
to  starting  values.  All  nonlinear  fitting  routines.  Including  the  simplex 
algorithm,  require  Initial  estimates  of  the  (unknown)  parameters.  The 
simplex  method  will  converge  from  almost  any  starting  values.  (Of  course 
poor  Initial  estimates  require  more  computational  time.)  Derivative-based 
methods,  on  the  other  hand,  require  starting  values  close  to  the  unknown 
parameters.  This  consideration  becomes  especially  Important  In  the  analysis 
of  multidimensional  data. 

When  compared  to  derivative-based  methods,  the  simplex  method  has  two 
major  disadvantages:  lack  of  speed  and  the  absence  of  error  estimation.  The 
simplex  method  Is  much  slower  than  Hessian  methods,  and  becomes  even  slower 
as  the  number  of  variables  Increases.  Problems  with  long  computational  times 
can  be  mitigated,  but  not  eliminated,  by  efficient  coding  In  a  language  such 
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as  FORTRAN.  In  particularly  bad  cases,  calculations  can  be  run  overnight  and 
the  results  examined  the  next  day.  The  absence  of  error  estimates  Is  not  a 
significant  problem  for  experimental  optimization,  particularly  If  a 
parametric  model  does  not  exist  for  the  response  surface.  However,  when 
fitting  data  to  theoretical  models  the  lack  of  error  estimates  Is  a 
fundamental  problem.  Analytical  results  are  Incomplete  without  a  measure  of 
uncertainty  In  addition  to  an  estimate  for  the  unknown  quantity.  This  Is 
Illustrated  In  Figure  1,  where  absorbance  versus  time  data  from  reference  1 
have  been  modeled  using  a  simplex  algorithm.  The  data  In  Figure  2  were 
obtained  from  Figure  1  by  a  200*  Increase  In  the  residuals.  The  parameter 
estimates  are  the  same  for  both  cases.  However  the  results  are  clearly  not 
equally  reliable. 

The  simplex  method  first  attracted  our  Interest  during  an  ultrasonic 
absorption  study  of  metal  Ion  complexatlon  kinetics.  To  maximize  the 
Information  obtained  from  our  kinetic  measurements,  we  explored  the 
possibility  of  using  existing  theoretical  models  for  a  multidimensional  fit 
of  the  acoustic  absorption  coefficient  as  a  function  of  acoustic  frequency, 
temperature,  and  concentration.  A  Levenburg-Marquardt  nonlinear  least 
squares  algorlthm(lO)  has  normally  been  used  In  our  work;  however, 
application  of  this  routine  would  require  evaluation  of  the  partial 
derivatives  of  a  complex  function  and,  more  Importantly,  "good"  Initial 
estimates  of  the  unknown  parameters.  The  simplex  algorithm  provides  a  method 
of  avoiding  these  problems,  but  lacks  error  estimates. 

This  paper  Is  concerned  with  the  estimation  of  errors  In  the  calculated 
parameters  when  using  the  simplex  method  for  curve  fitting.  A  proposal  by 
Nelder  and  Mead  has  been  Incorporated  Into  a  subroutine  which  can  be 
Implemented  with  only  minor  modifications  to  an  existing  simplex  algorithm. 


Although  this  proposal  Is  conceptually  simple,  our  experience  has  shown  that 
problems  can  arise  In  Its  Implementation  unless  care  Is  taken.  These 
problems,  our  solutions  to  them,  and  Improvements  to  the  original  proposal 
are  discussed  below;  our  experiences  may  be  beneficial  to  others.  The 
procedure  Is  first  outlined  for  a  general  function,  and  then  Illustrated  for 
the  data  set  In  Figure  1. 

EXPERIMENTAL 

The  calculations  reported  below  were  performed  on  a  DEC  LSI  11/23 
computer  with  32K  words  of  memory.  A  variable-size  simplex  algorithm  coded 
in  FORTRAN  by  O'Neil  1(11)  was  used  with  minor  mod1f1cat1ons(12-14) .  Matrix 
Inversion  was  accomplished  using  subroutines  from  the  LINPACK  11brary(15), 
although  other  statistical  packages  or  locally  developed  programs  should 
also  be  satisfactory. 

The  algorithm  by  O'Neill  was  converted  to  single  precision,  except  for 
variance  calculations.  Most  chemical  data  are  not  sufficiently  precise  to 
warrant  the  additional  computer  memory  and  time  required  by  double 
precision  calculations.  These  requirements  are  particularly  Important  when 
computations  are  done  on  a  laboratory  minicomputer  such  as  the  LSI.  For 
Instance,  kinetic  data  are  obtained  In  our  laboratory  with  an  8  bit  ADC 
(Tektronix  7020)  and  have  a  precision  of  1  part  In  256.  Double  precision 
arithmetic  with  a  precision  of  1  part  In  10*®  Is  clearly  not  justified. 

The  objective  function  being  minimized  Is  the  sum  of  squares  between 

the  measured  and  predicted  observations.  Following  Bevlngton's  notation, 

2 

this  function  will  be  referred  to  as  x  (16)*  At  convergence  the  variance 
between  the  best  k  vertices  of  the  simplex  Is  less  than  a  preset  tolerance, 
where  k  equals  the  number  of  unknown  parameters.  This  criterion  was 
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suggested  by  Nelder  and  Mead(3)  as  being  particularly  advantageous  for 
least  squares  function  minimization.  The  exact  value  of  this  tolerance  can 
significantly  affect  the  estimated  errors  unless  the  precautions  outlined 
below  are  followed. 

DESCRIPTION  OF  METHOD 

The  simplex  procedure  derives  its  name  from  the  geometrical  figure 
which  moves  across  the  error  surface  In  search  of  the  minimum:  a  simplex  is 
a  figure  defined  by  one  more  point  than  the  number  of  unknown  parameters  In 
the  function.  For  example,  if  experimental  data  are  being  fit  to  a  function 
with  three  unknown  parameters,  the  simplex  will  consist  of  four  vertices  in 
a  three-dimensional  space.  Each  point  represents  a  set  of  parameter  values, 
and  is  associated  with  a  vector  In  parameter  space.  The  vertex  with  the 
highest  value  of  the  error  function  Is  eliminated  and  replaced  by  Its 
reflection  In  the  hyperspace  defined  by  the  remaining  vertices.  The  rules 
governing  this  action  have  been  discussed  elsewhere (1,6)  and  will  not  be 
repeated  here.  This  paper  will  confine  its  attention  to  the  estimation  of 
errors  in  the  fitted  parameters. 

For  purposes  of  discussion,  assume  one  is  trying  to  fit  n  experimental 
observations  to  a  nonlinear  function,  f,  with  k  unknown  parameters.  The 
quantity  being  minimized  Is 

X2=  wi(yi-f1)2  (1) 

where  y^  and  f^  are  the  1th  observed  and  predicted  data  points, 
respectively,  and  w^  Is  the  weight  due  to  nonconstant  variance.  (In  cases 
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of  constant  variance,  Is  unity  for  all  observations.)  Once  x  has  been 

minimized  the  ''standard"  simplex  algorithm  Is  complete;  however  errors  In 

the  parameter  estimates  have  not  yet  been  determined. 

A  brief  review  of  etror  estimation  In  nonlinear  least  squares  Is 

appropriate  at  this  point.  Host  error  estimates  are  derived  from  the 

curvature  matrix  evaluated  at  the  minimum  In  the  error  surface(16). 

Qualitatively,  If  the  curvature  with  respect  to  a  parameter,  0^,  Is  small, 
2 

then  x  Is  relatively  Insensitive  to  the  variation  In  that  parameter. 
Therefore,  6^  Is  not  well  defined  and  will  have  a  large  uncertainty. 
Conversely,  If  the  curvature  Is  large,  that  parameter  will  be  well  defined 
and  have  a  small  uncertainty.  The  curvature  matrix,  a,  contains  the  second 
partial  derivatives  of  x  •  The  1j  element  of  o  Is  given  by 


a 


1j 


30 1 30  j 


(2) 


The  variance-covariance  matrix  contains  estimates  of  the  errors  In  the 

2-1  2 

parameters,  and  Is  given  by  e  =  s  a  .  The  quantity  s  Is  the  mean  square 

2  ^ 
error,  and  equals  x  /(n-k).  The  estimated  standard  deviation  In  the  1 

parameter  Is  given  by 


°8,  '  S  /£11  <3) 

where  e . ,  Is  the  1th  diagonal  element  of  c. 

This  suggests  that  the  simplex  estimates  can  be  used  to  calculate 
partial  derivatives  and  form  the  curvature  matrix.  This  matrix  can  then  be 
Inverted  and  used  to  compute  the  variance-covariance  matrix.  Martin  and 
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Hackbarth(17)  followed  a  similar  approach,  using  a  commercial  software 
package  to  calculate  the  statistical  properties  of  the  simplex  estimates. 
The  size  of  the  commercial  package  used  required  that  these  calculations  be 
done  on  a  large,  centrally  located  computer.  The  current  popularity  of 
laboratory  computers  results  in  large  part  from  their  ability  to  provide 
experimental  control  (including  data  acquision)  as  well  as  to  analyze  data. 
Consequently,  the  simplex  algorithm  should  be  capable  of  both  curve  fitting 
and  the  estimation  of  errors  in  fitted  parameters. 

The  simplex  method  does  not  yield  any  estimate  of  the  curvature  matrix 
of  second  derivatives  at  the  minimum.  In  their  article,  Nelder  and  Mead 
briefly  discuss  a  method  of  constructing  this  matrix  without  the  evaluation 
of  derivatives.  A  detailed  mathematical  proof  of  their  approach  Is  beyond 
the  scope  of  this  article;  the  Interested  reader  Is  referred  to  the 
original  work(2,3).  A  flow  chart  of  the  procedure,  including  our 
modifications.  Is  presented  In  Figure  3. 

The  final  simplex  consists  of  k+1  vertices  In  k-dlmenslonal  parameter 
space.  Let  these  vertices  be  denoted  by  VQ,  ....  V^,  with  x2  denoting  the 
value  of  the  error  surface  at  vertex  V^.  Further,  let  VQ  be  the  vertex  with 
the  lowest  error,  x0*  Finally,  let  *  (8^  ...,  8^  k)  be  the  parameter 

vector  corresponding  to  vertex  V^.  As  usual  the  superscript  “t"  denotes 
transpose. 

A  quadratic  approximation  can  be  used  to  fit  the  error  surface  in  the 

vicinity  of  the  final  simplex.  The  k+1  points  of  the  final  simplex  are 

combined  to  form  "half-way  points"  j=($1+5 j)/2,  The  value  of  x2  at 

9.j j  Is  denoted  by  x^y  The  combined  set  of  (k+l)(k+2)/2  points  are  then 

2 

used  to  calculate  x  near  the  minimum: 


Table  I  defines  the  quantities  In  the  above  equation  In  terns  of  the  values 
2 

of  x  •  Initially  equation  4  may  appear  to  be  needlessly  complex  and  no 
improvement  over  more  conventional  approaches.  The  Importance  of  this 
equation  lies  In  its  ability  to  define  the  gradient  ((Q”1)^)  and  the 
curvature  matrix  (0.5  (Q~^)*BQ“*)  as  simple  functions  of  the  error  surface. 

In  using  this  approach.  It  is  necessary  to  avoid  two  extremes:  (1) 
allowing  the  final  simplex  to  become  so  small  that  the  elements  of  the  B 

2 

matrix  are  largely  the  result  of  rounding  errors  In  the  calculation  of  x  . 

or  (2)  a  simplex  so  large  that  the  quadratic  approximation  Is  not  valid. 

Our  experience  with  a  variable  size  simplex  algorithm  suggests  the  first 

extreme  presents  the  greater  hazard.  This  Is  particularly  true  when  an 

overly  strict  convergence  criterion  Is  applied.  The  curvature  of  the  error 

surface  decreases  as  the  final  simplex  becomes  smaller.  The  elements  of  the 

B  matrix  are  a  measure  of  this  curvature,  and  hence  become  poorly  defined. 

The  seriousness  of  this  hazard  will,  of  course,  depend  on  the  shape  of  the 

error  surface  and  the  function  being  fit. 

To  protect  against  a  lack  of  curvature,  Nelder  and  Mead(3)  suggested 
2  2  3 

that  the  difference  x^  -  Xq  should  be  at  least  10  times  greater  than  the 

2 

roundoff  error  In  the  calculation  of  x  •  Our  experience  has  been  that  the 

2  2  2 

relative  difference,  (x^  -  Xq)/Xq*  gives  superior  performance.  If  this 
condition  Is  not  satisfied,  the  distance  between  and  the  centroid  is 
doubled  and  the  condition  checked  again.  This  process  Is  repeated  for  each 
vertex  until  the  Inequality  Is  satisfied.  Our  work  has  indicated  that  use 
of  the  relative  difference  along  with  realistic  estimates  of  the  roundoff 
error  provides  protection  against  both  extremes. 


Once  the  final  vertices  have  been  checked  for  sufficient  curvature, 
"half-way  points"  j  are  computed  for  1  i  j.  With  these  points,  sufficient 
values  of  the  error  surface  exist  to  construct  the  quadratic  surface  given 
in  equation  4.  The  parameter  vector  corresponding  to  the  minimum  In  the 
error  surface  Is  easily  calculated: 

5„1n  -  50  -  «B'1;  <5> 

The  inequality 

atB”1B"1a  <  1/4  (6) 

provides  a  check  on  the  validity  of  the  quadratic  approximation.  If  this 
inequality  Is  not  valid,  is  replaced  by  In  Table  I,  the  elements  of 
a,  B,  and  Q  are  reevaluated  and  a  new  ($min  calculated.  Our  experience  to 
date  has  been  that  and  do  not  differ  significantly.  Nonetheless, 
these  calculations  provide  an  additional  check  on  the  adequacy  of  the 
quadratic  approximation. 

Finally,  using  updated  versions  of  Q  and  B,  the  error  matrix  can  be 
calculated: 

e  *  s2  2  qV^  (7) 

2  p 

where  s  =  ^  ^mln  an<*  ^0  are  identical,  the  existing  Q  and  B 

matrices  can  be  used  in  this  calculation.  Given  the  ease  of  forming  new 
matrices  using  In  place  of  §q  In  Table  I,  we  prefer  to  calculate 
updated  matrices.  Since  function  evaluations  are  Inexpensive  In  terms  of 
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computer  time  and  memory,  the  only  additional  cost  of  this  procedure  Is  the 
Inversion  of  the  B  matrix. 

ILLUSTRATION 

An  appreciation  of  the  preceedlng  discussion  can  be  gained  by 
estimating  the  errors  In  the  parameters  obtained  when  fitting  the  data  in 
Figure  1.  The  calculations  Involved  In  the  application  of  simplex 
minimization  to  this  data  set  have  been  Illustrated  e1sewhere(l,8) .  Our 
concern  Is  limited  to  the  calculation  of  error  estimates  after  the 
minimization  has  been  completed.  We  have  analyzed  this  data  set  using 
simplex,  Levenburg-Marquardt,  and  Gauss-Newton  programs;  as  seen  In  Table 
II,  the  estimated  parameters  from  each  program  are  In  agreement  with  those 
obtained  by  previous  authors (1,8). 

The  data  are  being  fit  to  the  nonlinear  model 

A  -  AJ1  -  e‘kt)  (8) 

where  A  Is  absorbance,  t  Is  time,  A  Is  the  absorbance  at  Infinite  time, 

CD 

and  k  Is  the  rate  constant.  A  3-dlmenslonal  plot  of  the  error  surface  Is 
shown  In  Figure  4.  Cross  sections  of  the  error  surface  at  the  fitted  values 
for  A  and  k  are  shown  In  Figure  5.  This  figure  clearly  demonstrates  that 
A^  Is  more  precisely  defined  than  k,  and  Is  a  strong  argument  for  the 
estimation  of  parameter  errors  In  the  analysis  of  this  data  set,  as  well  as 
data  In  other  areas  of  chemistry. 

p 

After  minimizing  x  *  the  final  simplex  consists  of  three  vertices  In  a 
2-dlmenslonal  parameter  space.  There  are  two  unknown  parameters  (A^  and  k). 


VI 
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Figure  6  shows  these  vertices  superimposed  on  a  contour  plot  of  the  error 
surface  In  the  vicinity  of  the  minimum.  As  discussed  In  the  previous 
section,  proper  error  estimation  requires  that  the  curvature  matrix  be 
computed  from  vertices  sufficiently  close  together  In  parameter  space  so 
that  the  quadratic  approximation  Is  valid,  but  sufficiently  separated  so 
that  the  calculations  are  not  simply  the  result  of  rounding  error.  It  Is  of 
Interest  to  note  that  If  the  "final"  vertices  from  O'Neill's  simplex 
algorithm  are  used  to  calculate  error  estimates,  these  errors  are 
physically  unrealistic  (l.e.  negative  numbers).  Application  of  the 
procedure  outlined  In  Figure  3  results  In  an  "expanded"  set  of  vertices 
surrounding  the  minimum.  These  "expanded"  vertices  and  the  resulting  "half¬ 
way"  points  are  Included  In  Figure  6.  Considering  the  distorted  shape  of 
the  error  surface,  the  ability  of  this  procedure  to  envelope  the  minimum 
and  produce  error  estimates  Is  quite  good.  The  validity  of  our  error 
estimates  can  readily  be  appreciated  when  compared  to  more  sophisticated 
methods  (see  Table  II). 

Workers  using  the  simplex  commonly  quote  the  standard  deviation  for 
lack  of  fit,  s,  as  an  Indication  of  precision  In  fitted  parameters.  In  the 
above  example,  the  relative  standard  deviation  In  k  equals  275X  that  In  A  , 
demonstrating  the  Inadequacy  of  s  as  a  measure  of  the  uncertainties  In 
these  quantities.  The  Importance  of  this  problem  Is,  of  course,  a  function 
of  the  model  being  fit,  and  another  reason  why  parameter  estimation  Is  not 
considered  complete  without  some  estimation  of  the  parameter  errors. 


12 


V 


a‘ 


CONCLUSION 

Much  of  the  work  Involving  the  simplex  method  In  analytical  chemistry 
has  Involved  experimental  optimization^).  Error  estimation  Is  often  not 
appropriate  for  methods  development  or  the  optimization  of  Instrumental 
conditions.  In  most  of  these  cases,  there  Is  no  precise  understanding  of 
the  relationship  between  the  Individual  factors.  One  of  the  advantages  of 
the  simplex  method  Is  Its  ability  to  function  In  these  types  of  situations. 
Consequently,  error  analysis  has  not  received  the  attention  It  deserves. 

The  simplex  method  can  also  be  a  useful  tool  for  data  analysis  In 
analytical  chem1stry(7).  This  technique  Is  conceptually  simple,  easily 
programmed  on  laboratory  minicomputers,  readily  applicable  to  complex 
functions,  and  does  not  require  either  the  evaluation  of  derivatives  or 
starting  estimates  which  are  close  to  the  final  (unknown)  values.  However, 
to  be  useful  for  data  analysis  In  a  quantitative  science  such  as  analytical 
chemistry,  the  simplex  method  must  provide  error  estimates  of  the  final 
parameters.  To  the  best  of  our  knowledge,  currently  available  simplex 
routines  for  minicomputers  do  not  provide  these  estimates. 

This  paper  has  discussed  a  method  for  calculating  error  estimates,  and 
the  Important  factors  In  Its  Implementation.  The  technique  has  been 
discussed  In  general  terms,  and  then  Illustrated  using  one  specific  data 
set.  However,  this  method  Is  applicable  to  all  problems  In  which 
experimental  data  are  fit  to  a  mathematical  model.  It  can  be  easily 
Incorporated  Into  existing  simplex  routines,  without  requiring  extensive 
computer  memory  or  statistical  expertise  from  the  chemist.  In  spite  of  this 
simplicity,  this  method  has  a  sound  statistical  basis  and  can  provide 
chemists  with  much  useful  Information. 
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Table  I.  Matrix  Elements  in  Equation  4. 


a  vector: 

*i 

*  2  *01  ' 

■  (*i 1 

■  3  x|)/2 

1*1, . . . ,k. 

B  matrix: 

»n 

“  2  <X,  " 

h  4  ■ 

2*0i> 

1*1, ...,k. 

bu 

- 2  <4j 

*  4  ■ 

2  2, 

‘  X01  "  x0j) 

iyj. 

Q  matrix: 

qU 

■5u  - 

*0.1 

1*1,* • • ,k. 

J*1 , • • • ,k . 
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Table  II.  Nonlinear  Analysis  of  Data  In  Figure  1. 


Method 

A  ,  absorbance  at  t— 

09 

Estimate  Error- 

k,  rate 

Estimate 

constant 

Error- 

Simplex 

Reference  1 

.404 

b 

.170 

b 

Reference  8 

.404 

b 

.170 

b 

This  work 

.404 

.012 

.170 

.013 

Marquardt- 

.404 

.009 

.170 

.010 

Newton- 

.404 

.006 

.170 

.007 

-Standard  deviation  of  the  estimated  parameter. 
^Not  calculated  In  the  original  work. 

^Computed  using  the  IMSL  library. 


Figure  1.  Absorbance  versus  tine  data  fron  reference  1.  The  solid  line 
represents  the  nonlinear  least  squares  fit  using  a  slnplex 
algorithm. 

Figure  2.  Absorbance  versus  tine  data  obtained  fron  Figure  1  by  a  2002 
Increase  In  the  noise.  Note  that  the  fitted  parameters  are 
unchanged  In  value,  but  are  clearly  less  reliable. 

Figure  3.  A  flow  chart  for  the  estimation  of  errors  In  the  parameters 
calculated  by  a  simplex  algorithm. 

Figure  4.  A  3-dlnenslonal  plot  of  the  error  surface  for  the  data  from 
Figure  1. 

Figure  5.  Cross  sections  of  the  error  surface  obtained  when  k  Is  varied  at 
Aa*. 40436  ( - ),  and  when  A^  Is  varied  for  k*. 16968  ( - ). 

Figure  6.  Contour  plot  of  the  error  surface  In  the  vicinity  of  the  minimum. 

Key  to  symbols:  (o)  vertices  In  the  final  simplex  of  the  fitting 
routine,  (*)  vertices  used  to  estimate  errors,  and  (+)  position 
of  the  minimum  In  parameter  space.  Note  that  the  position  of  the 
final  minimum  coincides  with  one  of  the  vertices  from  the  simplex 
routine. 
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Brief 

The  simplex  method  Is  frequently  associated  with  experimental 
optimization.  However,  It  Is  also  a  valuable  technique  for  nonlinear  data 
analysis.  Current  versions  of  the  simplex  algorithm  do  not  provide  error 
estimates  of  the  fitted  parameters.  The  Importance  of  these  estimates  Is 
discussed  and  a  procedure  Is  described  for  their  calculation  on  laboratory 


minicomputer*. 


